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A SYSTEM AND METHOD OF EPSILON REMOVAL OF WEIGHTED 
AUTOMATA AND TRANSDUCERS 

RELATED APPLICATION 

The present application is related to Attorney Docket No. 2001-0226-A 
entitled "A System and Method of Epsilon Removal of Weighted Automata and 
Transducers", by Mehryar Mohri, assigned to the assignee of the present invention. 
The contents of that application are incorporated herein. 

1 . Field of the Invention 

The present invention is directed to a system and method for epsilon removal 
of weighted automata and transducers. More specifically, the present invention 
relates to a system and method of computing a weighted automaton B with no 
epsilons that is equivalent to the input automaton A. 

2 . Brief Description of the Related Art 

In natural language processing and speech recognition systems, certain 
algorithms and processes have been developed to receive speech signals and 
determine what word or phrase has been spoken. The algorithms and processes for 
speech processing applications are a particular application of finite state machines 
(FSMs). Finite state machines are devices that allow for simple and accurate design 
of sequential logic and control functions. Finite state machines have many 
applications and while the present disclosure specifically relates to speech recognition 
systems, the basic principles disclosed herein may have other applications beyond 
speech recognition or signal processing. Some examples of other contexts in which 
the present invention may apply include text-processing systems such as information 
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extraction systems, or systems for information retrieval, pattern matching, and 
computational biology. An FSM is called a "finite" state machine because there are 
only a limited (finite) number of states. In a simple sense, a door is a finite state 
machine because it can be in one of two states: open or closed. 

A main design tool for FSMs is the state transition diagram or state diagram. 
The state transition diagram illustrates the relationships between the system states and 
the events that cause the system to change from one state to the next. Figure 1 , 
discussed below, illustrates an example state transition diagram in the speech 
recognition process. Disclosed herein are previous methods and systems for 
converting a particular FSM into a more simple and efficient FSM that maintains the 
same functionality as the original FSM. The previous methods relate to removing 
unnecessary transitions from state to state within an FSM. 

It is well known that finite state techniques have proven invaluable in a variety 
of natural language processing applications, A tool useful in natural language 
processing is the weighted finite state automata and weighted finite state transducer. 
Such a transducer is described in U.S. patent applications 6,032,1 1 1 to Mehryar 
Mohri, assigned to AT&T Corp., and which contents are incorporated herein by 
reference. Further background maybe gained from "The Design Principles of a 
Weighted Finite-State Transducer Library" by Mehryar Mohri, Fernando Pereira and 
Michael Riley, available on the Internet at: 

http://citeseer.nj.nec.com/mohriQQdesign.html; and "Weighted Automata in Text and 
Speech Processing", by Mehryar Mohri, Fernando Pereira, and Michael Riley, found 
on the Internet at: http://citeseer.m\nec.com/mohri96weighted.html The contents of 
these two publications are incorporated herein by reference for background 
information. 
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Figure 1 illustrates a weighted automaton 10 where each circle 12 is a "state" 
and the arrows between the states 14, 16 represent events causing the change of state. 
The weights given to the state transitions are positive real numbers representing 
negative logarithms of probabilities. Weights along the paths are added and when 
several paths correspond to the same string, the weight of the string is the minimum of 
the weights of those paths. Transitions 16 represent the ^-weighted transitions 
discussed herein. The ^-weighted transitions are "empty" strings with no value. 

Weighted automata are efficient and convenient devices used in many 
applications such as text, speech and image processing. The automata obtained in 
such applications are often the result of various complex operations, some of them 
introducing the empty string "8". For the most efficient use of an automaton, it is 
preferable to remove the s's of automata since in general they introduce delay when 
used. An algorithm that constructs an automaton B with no s's equivalent to an input 
automaton^ with e's is called an "^-removal" algorithm. 

The relevant art does not present ^-removal of unweighted automata as an 
independent algorithm deserving a specific study. Instead, the ^-removal process is 
often mixed with other optimization algorithms such as determinization. This usually 
makes the presentation of determinization more complex and the underlying s- 
removal process obscure. Since ^-removal is not presented as an independent 
algorithm, it is usually not analyzed and its running time complexity not clearly 
determined. 

The present disclosure will provide discussion and explanation of a finite-state 
library algorithm for removal of an s -weight on automata and transducers. The 
concepts of weights to automata, automatons, and transducers, as well as known 
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algorithms for ^-removal are discussed. One of ordinary skill in the art will be 
familiar with the terms waited acceptor, weighted transducer, automata, automaton, 
and semiring. Background and information on these terms may be found in the 
references cited above as well as other well-known documentation. 

Weight in the automata is a generalization of the notion of automaton: each 
transition of a weighted automaton is assigned a weight in addition to the usual labels. 
More formally, a weighted acceptor over finite alphabets and a semiring K is a finite 
directed graph with nodes representing states and arcs representing transitions in 
which each transition t is labeled with an input i(t) e E and a weight w(t) e K. 

Furthermore, each state t has an initial weight and a final weight. In a 
weighted transducer, each transition t has also an output label oft) e A* where A is 
the transducer's output alphabet. A state q is initial if X(q) * O, and final if p(q) * O. 
For more information on the mathematical operations of the equations dissclosed 
herein, see Werner Kuich and Arto Salomaa, Semirings, Automata, Languages, 
number 5 in EATCS Monographs on Theoretical Computer Science, published by 
Springer- Verlag, Berlin, Germany, 1986. A person of ordinary skill in the art will 
understand the algebraic operation and symbols used in the formulas disclosed herein. 
Therefore, an explanation of each algebraic operator and of the various terms used in 
the formulas is not provided. 

In the design of a weighted finite state transducer library, most algorithms 
operate on general weighted automata and transducers. The general framework for 
solving all pairs shortest-paths problems - closed semirings - is compatible with the 
abstract notion of weights commonly used, thus it is preferable to include an efficient 
version of the generic algorithm of the Floyd-Warshall algorithm in some finite-state 
machine libraries. The Floyd-Warshall algorithm addresses the desire in finite-state 
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machine libraries to determine the shortest distance between all nodes and all other 
nodes in the finite state machine. Determining these shortest distance values for each 
node to each other node relates to the problem of "All-Pairs-Shortest-Path" which is 
solved by the Floyd-Warshall algorithm. Using the Floyd-Warshall algorithm code 
can provide the all pairs shortest distances when the weights between the nodes are 
real numbers representing, for example, probabilities but also when they are strings or 
regular expressions. This case is useful to generate efficiently a regular expression 
equivalent to a given automaton. The Floyd-Warshall algorithm is also useful in the 
general ^-removal algorithm discussed next. 

Composition is the key operation on weighted transducers. The composition 
algorithm in the weighted case is related to the standard unweighted transducer 
composition and acceptor intersection algorithms, but in general weighted s- 
transitions complicate matters. The input or output label of a transducer transition 
may be the symbol s representing a null label. A null input label indicates that no 
symbol needs to be consumed when traversing the transition, and a null output label 
indicates that no symbol is output when traversing the transition. Null labels are 
needed because input and output strings do not always have the same length. For 
example, a word sequence is much shorter than the corresponding phonetic 
transcription. Null labels are a convenient way of delaying inputs or outputs, which 
may have important computation effects. In the weighted finite-state transducers used 
for example in speech recognition, transitions with null labels may also have a weight. 

The presence of null labels makes the composition operation for weighted 
transducers more delicate than that for unweighted transducers. The problem is 
illustrated with the composition of the two transducers A and B shown in Figures 2(a) 
and 2(b). Transducer A has output null transitions, while transducer B has input null 
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transitions. To help understand how these null transitions interact, refer to derived 
transducers A' and B' in Figures 2(c) and 2(d). In transducer A\ the output null 
transitions are labeled and the corresponding null moves in B" are explicitly 
marked as self-transitions with input label Likewise, the input null transitions of B 
are labeled with si in B\ and the corresponding self-transitions in A' have output label 
£j. Any transition in the composition of A and B has corresponding transition in the 
composition of A ' and B \ but whereas an output null label in A or an input null label 
in B corresponds to staying in the same state on the other transducer, in the 
composition of A' and B\ the corresponding transition is made from a pair of 
transitions with matching A -output and 5-input labels 5*. 

Figure 3 illustrates the pseudocode of a generic epsilon removal algorithm for 
weighted automata. This ^-removal algorithm is explained further in the article: "The 
Design Principles of a Weighted Finite-State Transducer Library" incorporated above. 
Given a weighted automaton M u the algorithm returns an equivalents weighted 
automaton M 0 without ^-transitions, TransMfs] denotes to set of transitions leaving 
state s in an automaton M f Next(t) denotes the destination state of transition t, i(t) 
denotes its input label, and w(t) its weight. Lines 1 and 2 extract from M t the 
subautomaton M e containing all the non-s transitions. Line 3 applies the general all- 
pairs shortest distance algorithm Closure to M e to derive the ^-closure G € . The 
nested loops starting in lines 4, 5 and 6 iterate over all pair of an ^-closure transition e 
and a non-s transition t such that the destination of e is the source of /. Line 7 looks in 
M 0 for a transition f with label I(t) from e's source from t's destination if it exists, or 
creates a new one with eight O if it does not. This transition is the result of extending 
/ "backwords" with the Mi £-path represented by ^-closure transition e. Its weight, 
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updated in line 8, is the semiring sum of such extended transitions with a given source 
destination and label. 

In most speech processing applications, the appropriate weight algebra is the 
tropical semiring. Weights are positive real numbers representing negative logarithms 
of probabilities. Weights along the path are added; when several paths correspond the 
same string in the weight of the string is the minimum of the weights of those paths. 

As noted before, the computation of the key closure requires the computation 
of the all pairs shortest distances in M e . In the case of idempotent semirings such as 
the tropical semiring, the most efficient algorithm available is Johnson's algorithm, 
which is based on the algorithms of Dykstra and Bellman-Ford. Details regarding 
Johnson's algorithm are found in T. Cornien, C. Leiserson and R. Rivest, Introduction 
to Algorithms , published by the MIT Press, Cambridge, MA, 1992. 

For running time, complexity of Johnson's algorithm is 0(\Q\2 log\Q\ + 
| when using Fibonacci heaps, but often the more general but less efficient 
Floyd- Warshall algorithm is used instead because it supports non-idempotent closed 
semirings. Further details regarding Fibonacci heaps are found in Introduction to 
Algorithms referenced above. When M £ is acyclic, the linear time topological sort 
algorithm is used which also works with non-idempotent semirings. 

Figure 4 illustrates the result of an application of ^-removal to a weighted 
automata of the tropical semiring of Figure 1 . The example shows that the <?-removal 
algorithm generalizes the classical unweighted algorithm by ensuring that the weight 
of any string accepted by the automaton is preserved in the £-free result 20. In Figure 
4, the states 22 and transitions 24 of the £-free automaton 20 preserve the weight of 
any string accepted by the original automaton 10 shown in Figure 1. 
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There are inefficiencies within the related use of ^-removal algorithms. For 
example, the ^--removal process is often presented in a mixture of other optimization 
algorithms such as determinations. See, e.g., A. V. Aho, R. Sethi, and J. D. Ullman, 
Compilers, Principles, Techniques and Tools, published by Addison Wesley, Reading, 
MA, 1986. A generalization of the Floyd-Warshall algorithm is typically used in 
connection with ^-removal and introduces inefficiencies. First, in the ^-removal 
algorithm explained above, M s was decomposed into strongly connected components, 
and then the Floyd-Warshall algorithm was applied to each component, and then the 
acyclic algorithm was applied to the component graph of M s to compute the final 
results. These computational inefficiencies experienced by using the Floyd-Warshall 
algorithm were usually accepted given that each strongly connected component of M e 
is small relative to M/s overall size. 

Another disadvantage of obscuring the ^-removal process via its use with 
other algorithms is the difficulty in an independent analysis of the running-time 
complexity and efficiency of ^-removal. Therefore, accurate assessment of the 
efficiencies of such ^-removal processes becomes very difficult. 

SUMMARY OF THE INVENTION 

What is needed in the art is an independent ^-removal method for weighted 
automata and transducers defined over a semiring. The algorithm disclosed herein 
improves the efficiency of weighted automata used in applications such as speech 
recognition systems, speech synthesis systems and text processing systems. The s~ 
removal method is preferably used in the case of unweighted automata and 
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transducers and weighted automata and transducers defined over the tropical semiring 
based on the general shortest distance algorithm described herein. 

An improved ^-removal method is disclosed that computes for any input 
weighted automaton A with ^-transitions an equivalent weighted automaton B with no 
^-transitions. The method comprises two main steps. The first step consists of 
computing for each state "p" of the input automaton^ its ^-closure denoted by C[p]: 
C[p] = {(q,w): q £ s[p], d[p f q] = weK-{0}} 

Where s[p] represents a set of states reachable from "p" via a path labeled 
with s. The second step consists of modifying the outgoing transitions of each state 
"p" by removing those labels with s and by adding to be non-^-transitions leading 
each state q with their weights pre-®-multiplied by d[p,q]. 

The second step in the method comprises modifying the outgoing transitions 
of each state "/?" by removing those labeled with e. The method adds to the set of 
transitions leaving the state "p" non-£-transitions leaving each state in the set of 
states reachable from "/?" via a path labeled with e with their weights pre-®- 
multiplied by the ^-distance from state "p" to state "q" in the automaton A State "p" 
is a final state if some state "9" within the set of states reachable from "p" via a path 
labeled with e is final and the final weight p [p] is 

fl{p]= ® (d[p,q]®p[q])- 
e[p]r\F 

The resulting automaton B is the equivalent of automaton A without the s- 
transitions. Furthermore, the method disclosed herein has been implemented and is 
up to 600 times faster than previously known methods based on generalizations of 
algorithms such as the Floyd- Warshall algorithm. 
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The epsilon removal algorithm according to an aspect of the present invention 
of weighted automatic and transducers is a general optimization algorithm useful in 
all applications where weighted automata and transducers are used: speech 
recognition, speech synthesis, text processing, genome processing, information 
extraction, etc. Thus the present invention provides a dramatic improvement in the 
removal of epsilons from word lattices, which are compact representations of a large 
number of recognition hypotheses with the associated weights, produced by a 
recognizer. The invention is preferably applied before the application of other 
optimizations such as weighted determinization and minimization. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing advantages of the present invention will be apparent from the 
following detailed description of several embodiments of the invention with reference 
to the corresponding accompanying drawings, in which: 

Figure 1 illustrates a weighted automaton; 

Figures 2(a) - 2(b) illustrate the problem of the present of no labels that makes 
the composition operation for weighted transducers more difficult; 

Figures 2(c) - 2(d) illustrate how null transitions interact with relation to two 
derived transducers A' and B'; 

Figure 3 illustrates a pseudocode of the related art general ^-removal 
algorithm; 

Figure 4 illustrates a weighted automaton after an ^-removal process; 
Figure 5 (a) illustrates a tropical semiring for a weighted automaton^ with a 
transitions; 

10 
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Figure 5(b) illustrates a weighted automaton B equivalent to A result of the s- 
removal algorithm according to the first embodiment of the present invention; 

Figure 5(c) illustrates a weighted automaton C equivalent to A obtained by 
application of ^-removal to the reverse of A; 

Figure 6(a) illustrates s - removal in the real semiring (R, +, * 0, 1) for a 
weighted automaton A, where A £ is ^-closed for (R, +, * 0, 1); 

Figure 6(b) illustrates a weighted automaton B equivalent to A output of the s- 
removal algorithm; 

Figure 7 illustrates a generic single source shortest distance algorithm used in 
connection with the first step in the first embodiment of present invention; 

Figures 8(a) and 8(b) illustrate another aspect of the first embodiment of the 
invention regarding an input s-normalization method for weighted transducers; and 

Figures 9(a) and 9(b) illustrate another aspect of the first embodiment of the 
invention regarding an input s-normalization method for weighted transducers. 

DETAILED DESCRIPTION OF THE INVENTION 

Presented and disclosed herein is a novel generic ^-removal system and 
method for weighted automata and transducers defined over a semiring. The system 
or method can be used with any large class of semirings (framework) that covers the 
practical case of the semirings currently used for speech processing but that also 
includes other semirings that can be useful in speech and other domains. The system 
and method of the present invention also works with any queue discipline adopted, 
e.g., first-in-first-out (FIFO), shortest-first, etc. The present invention works with any 
k-closed semiring. 

n 
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The present invention is particularly useful for unweighted automata and 
transducers and weighted automata and transducers defined over the tropical 
semiring. The invention is based on a general shortest-distance algorithm that is 
described briefly herein. 

The method of the present invention is the first embodiment and will be 
described using example pseudocode and its running time complexity. The present 
disclosure further discusses the more efficient case of acyclic automata, an on-the-fly 
implementation of the method and an approximation method in the case of the 
semirings not covered by a specific framework. 

First Embodiment 

The first embodiment is illustrated with several semirings. Also described is 

an input ^-normalization method for weighted transducers, which is based on the 

general shortest-distance algorithm. The ^-normalization method, which works with 

all semirings covered by a specific framework, admits an on-the-fly implementation. 

An on-the-fly implementation allows one to use the algorithm with a lazy evaluation. 

In other words, instead of removing all the epsilons of the input machine all at once, 

one can remove only the epsilons that belong to the paths of the input a machine that 

one might be interested in. So, when some part of the input machine A is read, the 

output B (w/o epsilons) is constructed just for that part of A. 

As discussed above, weighted automata are automata in which the transitions 
are labeled with weights in addition to the usual alphabet symbols. For various 
operations to be well defined, the weight set needs to have the algebraic structure of a 
semiring. What follows includes some preliminary definitions and explanations of 
some terms necessary for understanding the present invention. A system K ® ® 0 1 is 
a right semiring if: 

1 . (K ® 0) is a commutative monoid with 0 as the identity element for ©, 

12 
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2. (K ® I) is a monoid with T as the identity element for ®, 

3. ® right distributes over ©: Va,Z>, c € K, (a 0 Z?) ® c = (a ® c) © (b ® c), 

4. 0 is an annihilator for ®: \fa e K , a ® 0 = 0 ® a = 0 . 

Left semirings are defined in a similar way by replacing right distributivity 
with left distributivity. (K,©,®, 0,1) is a semiring if both left and right distributivity 
hold. Thus, more informally, a semiring is a ring that may lack negation. As an 
example, (N, +, •, 0, 1) is a semiring defined on the set of nonnegative integers N. 

A semiring (K,©,®,0,T) is said to be idempotent if for any a e K, a © a = 
a. The Boolean semiring (3 = ({0, 1}, V, A, 0, 1) and the tropical semiring 
T= (tft/{oo},min, +, oo, 0 ) are idempotent, but (N, +, • 9 0, 1) is not. 

As a second definition, a weighted automaton A = (E, Q, /, F, E, \ p) over the 

semiring K is a '7-tuple where E is the finite alphabet of the automaton, Q is a finite 
set of states, leg the set of initial states, FqQ the set of final states, 
EcQxSxKxQ a finite set of transitions, X : I -> K is the initial weight function 
mapping I to K, and p : F -> K is the final weight function mapping F to K. 

Given a transition s e E, according to the present disclosure, i[e] is 
denoted as its input label, w[e] its weight, pfe] its origin or previous state and nfej its 
destination state or next state. Given a state q eQ, E[q] is the set of transitions 
leaving q 9 and by E R [q] the set of transitions entering q. 

A path 7i = ei ... e k in ^4 is an element of with consecutive transitions: n[ei_i] 
= p[ej, i = 2, ... , k The variables « and p are extended to paths by setting: n[ic]= 
nfekj and pfit] = /j/ey/. The notation P(q,q ') represents the set of paths from q to q\ 
P can be extended to subsets R c Q R ' c Q, by: 

P(R,R')= U Pfeff'^ 

The labeling function z and the weight function w can also be extended to paths by 

13 
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defining the label of a path as the concatenation of the labels of its constituent 
transitions, and the weight of a path as the ®-product of the weights of its constituent 
transitions: 

iM = ifei] - i[e k ] 

w[k] = wfej] ® •» ® w[e k J 

Given a string x e JY30> represents the set of paths from I to F labeled with 

The output weight associated by A to an input string % e E* is: 
MK^)= © A(#])®^]®P(»W) 

If = 0 , [A] (x) is defined to be 0 . Note that weighted automata over the 
Boolean semiring are equivalent to the classical unweighted finite automata. 

These definitions can be easily generalized to cover the case of any weighted 
automata with ^-transitions. An ^-removal algorithm computes for any input 
weighted automaton A with ^-transitions an equivalent weighted automaton B with no 
^-transition, that is such that: 

V X e2*, [A](X)-[B](X) 
Weighted finite-state transducers are defined in a similar way. 

As a further definition, a weighted transducer T = (2, Q, Q, /, F, E, \ p) over 
the semiring K is an 8-tuple where S is the finite input alphabet of the transducer, Q is 
the finite output alphabet of T, Q is a finite set of states, I c Q the set of initial states, 
F c Q the set of final states, EcQxS U {oo} xfi,U {oo} x Kx Q a finite set of 
transitions, A: I K the initial weight function mapping I to K, and p: F -> K the 

14 
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final weight function mapping F to K. 

The output weight associated by T to an input string igS and output string 7 

e Q is: 

[T]{Z>r)= © l{p[7t})®w[7r}®p(n[7r}) 

7t<zP{x,y) 

where P(x, y) is the set of paths with input label x and output label y. 

The following definitions will help to define the framework for the generic s- 
removal algorithm of an embodiment of the present invention. Let k > 0 be an 

integer. A commutative semiring (K®®01 ) is k-closed if; 

k+\ k 
VaeK, © a n = © a n 

When k = 0, the previous expression can be rewritten as: 
VaeK,T © a=l 
and K is then said to be bounded. Semirings such as the Boolean semiring p= 
({0, 1 } 9 V, A, 0,1) and the tropical semiring 7= (R+ u {00 }, min, + 00 , 0) are 
bounded. 

As yet another definition, let k > 0 be an integer, let ( K © ® 0 1 ) be a 
commutative semiring, and let A be a weighted automaton over K. (K© ®0 1 ) is 
right k-closed for A if for any cycle n of A; 

£+1 k 
© o)[7c] n = © m[nf 

n-0 n=0 

By definition, if K is Ar-closed, then it is ^-closed for any automaton over K. 

Given the above definitions and preliminary information, the first aspect of the 
first embodiment of the present invention is described next. This embodiment 
generally discloses a method of ^-removal for automatons. A second aspect of the 

15 
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first embodiment of the invention, discussed below, relates to an input s- 
normalization method for transducers. Further embodiments disclosed below relate 
to an apparatus or system for ^-removal. 

According to the first embodiment of the invention, let A = (S, Q, /, F, E, \ p) 
be a weighted automaton over the semiring K with ^-transitions. We denote by A £ the 
automaton obtained from A by removing all transitions not labeled with s. We present 
a general ^-removal algorithm for weighted automata based on a generic shortest- 
distance algorithm that works for any semiring K ^-closed forA £ . It is assumed that K 
has this property. This class of semirings includes in particular the Boolean semiring 
({0, 1}, V, A, 0, 1), the tropical semiring u {oo} ; min, + co,0) and other semirings 
not necessarily idempotent. 

The method of the first embodiment of the invention is presented by way of 
example for the case of weighted automata. The case of weighted transducers can be 
straightforwardly derived from the automata case by viewing a transducer as an 
automaton over the alphabet 2 U {&}x 2 U {s}. An ^-transition of a transducer is 
then a transition labeled with (s, s). 

For p, q in Q, the ^-distance from p to q in the automaton A is denoted by 
d[p, q] and defined as: 

d[p,q]= ® 0)[7T] 

This distance is well-defined for any pair of states (p,q) of A when K is a 
semiring k-closed for A 8 . By definition, for any p € Q, d[p,p]=l. The value d[p,q] 
is the distance from p to q in A £ . The class of semirings with which the generic 
shortest-distance algorithm works can in fact be extended to that of right semirings 
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right k-closed for A € . Related disclosure is found in U.S. Patent Application No. 
09/495174, filed February 1, 2001, by Mehryar Mohri, the contents of which 
application are incorporated herein. 

The first embodiment of the invention comprises two main steps. The first 
step comprises computing for each state p of the input automaton^ its ^-closure 
denoted by CfpJ: 

CfpJ = {(q,w) : q e efpj, dfp,q] = w e K- {O}} 
where efpj represents the set of states reachable from p via a path labeled with e. This 
step is described in more detail later with a discussion of ^-closures. The epsilon- 
closure step determines for each state p the set of states q that can be reached from p 
by paths labeled with epsilon. It also gives the total weight corresponding to all the 
epsilon-paths from p to q. The states q and their weights are used in the second step to 
remove all the epsilon-paths from p to q, to create new transitions from p to q with 
their weights adjusted with the weights of the states q. 

The second step comprises modifying the outgoing transitions of each state p 
by removing those labeled with e and by adding to Efpj non-e-transitions leaving each 
state q e e[p] with their weights pre-®-multiplied by d[p, qj. The following is 
example s-removal^ pseudocode related to the second step of this embodiment of 
the invention. 



1 for each p e Q 

2 do EfpJ^fee Efpj : ifej * e) 

3 for each (q,w) e C[p] 

4 do Efpj ^- Efpj U {(p,a,w 0w\r) : (q } a, w\ r) eEfqJ,a *e} 

5 ifq eF 

6 then if p 0 F 

7 then Y <~F U fp) 

8 Pfpj +-pfpJ®(co®pfqJ) 



State/? is a final state if some state q e efpj is final. If so, then the final 
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weight p[p] is then: 

p[p]= © (d[p 9 q]& p[q]) 

q<Ee[p]r\F 

Note the difference in the equations between the Greek letter " p " and the 
English letter "p". After removing £'s at each state p, some states may become 
inaccessible if they could only be reached by ^-transitions originally. Those states can 
be removed from the result in time linear in the size of the resulting machine using, 
for example, a depth-first search of the automaton. A depth-first search of the 
automaton may be accomplished, for example, by a classic algorithm disclosed in 
Introduction to Algorithm , by T. Cormen, C. Leiserson and R. Rivest, published by 
the MIT Press, Cambridge, MA, 1992. 

Figures 5(a)-(c) illustrate the use of the algorithm in the specific case of the 
tropical semiring. A tropical semiring A 30 is shown in Figure 5(a). The states 32 are 
connected with some non-^-transitions 34 and some ^-transitions 36. The ^-transitions 
36 can be removed in at least two ways: in the way described above, or the reverse. 

Figure 5(b) represents an automaton B produced by the ^-removal method of 
the first embodiment of the invention. Each state 42 is connected by non-£-transitions 
44 (only one transition is labeled but they are all non-^-transitions). Figure 5(c) 
represents an automaton C produced by applying ^-removal to the reverse of the 
automaton and re-reversing the result. As illustrated by Figures 5(b) and 5(c), 
different results can be obtained when applying the ^-removal method to an 
automaton or the reverse of an automaton. The different result is due to two factors 
that are independent of the semiring. 

First, the number of states in the original automaton A whose incoming 
transitions (or outgoing transitions in the reverse case) are all labeled with the empty 
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string. As mentioned before, those states can be removed from the result. For 
example, state 3 of the automaton of Figure 5 (a) can only be reached by ^-transitions 
and admits only outgoing transitions labeled with s. Thus, that state does not appear 
in the result in both methods (Figures 5(b)-(c)). The incoming transitions of state 2 
are all labeled with s and thus it does not appear in the result of the ^-removal with the 
first method, but it does in the reverse method because the outgoing transitions of 
state 2 are not all labeled with s. 

The second factor is that the total number of non ^-transitions of the states that 
can be reached from each state q in A e (the reverse of A & in the reverse case). This 
corresponds to the number of outgoing transitions of q in the result of ^-removal. 

In practice, heuristics may reduce the number of states and transitions of the 
resulting machine although this will not affect the worst-case complexity of the 
method disclosed herein. One can for instance remove some ^-transitions in the 
reverse way when that creates less transitions and others in the way corresponding to 
the first method when that helps reducing the resulting size. 

Figures 6(a)-(b) illustrate the application of the ^-removal algorithm of the 
first embodiment of the invention in the case of another semiring, the semiring of real 
numbers, or automaton A 60. As shown in Figure 6(a), the states 62 are connected 
via non-^-transitions 64 and ^-transitions 66. The automaton A € is ^-closed for (R, +, 
*, 0, 1). Figure 6(b) shows the weighted automaton B 70 with states 72 and all non- 
^-transitions 74 (only one transition is labeled) that is equivalent to automaton A 60. 
The general algorithm applies in this case since A e is acyclic. 

As mentioned above with respect to the first step of the method according to 
the first embodiment of the invention, the computation of ^-closures is equivalent to 
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that of all-pairs shortest-distances over the semiring K in A £ . There exists a 
generalization of the algorithm of Floyd-Warshall for computing the all-pairs shortest- 
distances over a semiring K under some general conditions. However, the running 
time complexity of that algorithm is cubic: 

O(\Q\ 3 (T<b + T0+TJ) 
where T®, T®, and T* denote the cost of ®, and closure operations in the semiring 
considered. The algorithm can be improved by first decomposing A s into its strongly 
connected components, and then computing all-pairs shortest distances in each 
components visited in reverse topological order. However, it is still impractical for 
large automata when A & has large cycles of several thousand states. The quadratic 
space complexity 0(\Q\ 2 ) of the algorithm also makes it prohibitive for such large 
automata. Another problem with this generalization of the algorithm of Floyd- 
Warshall is that it does not exploit the sparseness of the input automaton. 

There exists a generic single-source shortest-distance algorithm that works 
with any semiring covered by the framework. The algorithm is a generalization of the 
classical shortest-paths algorithms to the case of the semirings of this framework. 

This generalization is not trivial and does not require the semiring to be idem- 
potent. In particular, a straightforward extension of the classical algorithms based on 
a relaxation technique would not produce the correct result in general. The algorithm 
is also generic in the sense that it works with any queue discipline. Figure 7 
illustrates the pseudocode of the algorithm. The algorithm of Figure 7 works in 
particular with the semiring (R, +, *, 0, 1) when the weight of each cycle of ^admits 
a well-defined closure. 

Referring to Figure 7, a queue S is used to maintain the set of states whose 
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leaving transitions are to be relaxed. S is initialized to {s}. For each state q e Q, two 
attributes are maintained: d[q] e K an estimate of the shortest distance from s to q, 
and rfqJeK the total weight added to dfqj since the last time q was extracted from S. 
Lines 1 — 3 initialize arrays d and r. After initialization, dfqj r[q] = 0 for q eQ — 
{s}, and d[s] - r[s] = 1 . 

Given a state q g Q and a transition e e E[q], a relaxation step on e is 
performed by lines 1 1-13 of the pseudocode, where r is the value of r[q] just after the 
latest extraction of q from S if q has ever been extracted from S, its initialization value 
otherwise. 

Each time through the while loop of lines 5-15, a state q is extracted from S 
(lines 6-7). The value of r[q] just after extraction of q is stored in r, and then r[q] is 
set to O (lines 8-9). Lines 11-13 relax each transition leaving q. If the tentative 
shortest distance d[n[e]] is updated during the relaxation and ifnfe] is not already in 
S, the state nfej is inserted in S so that its leaving transitions be later relaxed (lines 14- 
15). Whenever d[n[e]J is updated, r[n[e]J is updated as well. r[n[e]] stores the total 
weight © added to dfnfeJJ since nfe] was last extracted from S or since the time after 
initialization if nfej has never been extracted from S, Finally, line 16 resets the value 
of d[s] to T. 

In the general case, the complexity of the algorithm depends on the semiring 
considered and the queue discipline chosen for S: 

0(\ Q | +(7 @ + 7 0 + C(A)) | E | max N{q) + (C(7) + C(E))Z qeQ N (<t)) 

q^Q 

where N(q) denotes the number of times state q is extracted from S, C(E) the worst 

cost of removing a state q from the queue S, C(I) that of inserting q in S, 

and C(A) the cost of an assignment. This includes the potential cost of reorganization 
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of the queue to perform this assignment. 

In the case of the tropical semiring (R+ U {oo} } mm, +, oo, 0), the method 
shown in Figure 7 coincides with classical single-source shortest-paths algorithms. In 
particular, it coincides with Bellman-Ford's algorithm when a FIFO queue discipline 
is used and with Dijkstra's algorithm when a shortest-first queue discipline is used. 
Using Fibonacci heaps, the complexity of Dijkstra's algorithm in the tropical semiring 
is: 

0(\E\ + \Q\iog\Q\) 

The book Introduction to Algorithms by Cormen, Leiserson and Rivest, referenced 
above, provides further material for these algorithms. The complexity of the 
algorithm is linear in the case of an acyclic automaton with a topological order queue 
discipline: 

0(\Q\ + CT* + TJ\E\) 
Note that the topological order queue discipline can be generalized to the case of non- 
acyclic automata A & by decomposing A & into its strongly connected components. 
Any queue discipline can then be used to compute the all-pairs shortest distances 
within each strongly connected component 

The all-pairs shortest-distances of A e can be computed by running \Q\ times the 
generic single-source shortest-distance algorithm. Thus, when A s is acyclic, that is, 
when A B admits no £-cycle, then the all-pairs shortest distances can be computed in 
quadratic time: 

O(\^\^(T^T 0 )\Q\ \E\) 
When A € is acyclic, the complexity of the computation of the all-pairs shortest 
distances can be substantially improved if the states of A £ are visited in reverse 
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topological order and if the shortest-distance algorithm is interleaved with the actual 
removal of s's. Indeed, one can proceed in the following way for each state p ofA s 
visited in reverse topological order: (1) Run a single-source shortest-distance 
algorithm with source p to compute the distance from p to each state q reachable from 
p by s's; and (2) Remove the ^-transitions leaving q as described in the previous 
section. 

The reverse topological order guarantees that the ^-paths leaving p are reduced 
to the ^--transitions leaving p. Thus, the cost of the shortest-distance algorithm run 
from p only depends on the number of ^-transitions leaving p and the total cost of the 
computation of the shortest-distances is linear: 

0(\Q\+CT* +T 0 )\E\) 
In the case of the tropical semiring and using Fibonacci heaps, the complexity of the 
first stage of the algorithm is: 

O0Q\'\E\+\Qf\og\Q\) 
In the worst case, in the second stage of the algorithm each state q belongs to 
the ^-closure of each state p, and the removal of a's can create in the order of \E\ 
transitions at each state. Hence, the complexity of the second stage of the algorithm 
is: 

0([Q\ 2 +\QVW 

Thus, the total complexity of the algorithm in the case of an acyclic automaton A s is: 

0(\Q\ 2 +(T* + T*\Q\'\E\) 
In the case of the tropical semiring and with a non acyclic automaton A & the total 
complexity of the algorithm is : 

0(\QY\E\ + \Q\ 2 \°%\Q\) 
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For some automata of about a thousand states with large ^-cycles, the inventor 
of the present invention has implemented the automata with an improvement of up to 
600 times faster than the previous implementation based on a generalization of the 
Floyd- Warshall algorithm. 

An important feature of the system and method of the present invention is that 
it admits a natural on-the-fly implementation. Indeed, the outgoing transitions of state 
q of the output automaton can be computed directly using the ^-closure of q. 
However, with an on-the-fly implementation, a topological order cannot be used for 
the queue S even if A s is acyclic since this is not known ahead of time. Thus, both an 
off-line and an on-the-fly version of the system and method of the present invention 
may be implemented. An on-the-fly algorithm can save space by removing only those 
epsilons that are necessary for the particular use of the input machine. An off-line 
algorithm simply applies to the entire machine and constructs the output regardless of 
what portion was really needed. In some cases as discussed above, the complexity of 
the off-line version is better because it can take advantage of the specific property of 
the machine (the fact that it is acyclic for example). This is not possible in the on-the- 
fly case. To allow for both uses, the present disclosure covers both the on-the-fly 
implementation and the off-line context. 

The shortest-distance algorithm presented herein admits an approximation 
version where the equality of line 1 1 in the pseudocode of Figure 7 is replaced by an 
approximate equality modulo some predefined constant 8. This can be used to 
remove ^-transitions of a weighted automaton A over a semiring K such as (R, +, *, 0, 
1), even when K is not ^-closed for A e . Although the transition weights are then only 
approximations of the correct results, this may be satisfactory for many practical 
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purposes such as speech processing applications. Furthermore, one can arbitrarily 
improve the quality of the approximation by reducing 8. As mentioned before, one 
can also use a generalization of the Floyd- Warshall algorithm to compute the result in 
an exact way in the case of machines A £ with relatively small strongly connected 
components and when the weight of each cycle of A € admits a well-defined closure. 

In another aspect of the first embodiment of the invention, a similar removal 
method is applied to transducers rather than automatons. The method according to 
this aspect of the first embodiment of the invention is closely related to the ^-removal 
method described above. As shown in Figures 8(a), let Tj 80 be a weighted transducer 
over a ^-closed semiring K. Tj includes states 82 and transitions with input label s 84. 
In some applications, one may wish to construct a new transducer T 2 equivalent to Tj 
such that T 2 has no ^-transition and such that along any successful path of T2, no 
transition with input label different from c is preceded with a transition with input 
label s. An exemplary transducer T2 90 is shown in Figure 8(b) with states 92 and 
transitions 94 having the appropriate ^-transition removes as described above. Figure 
8(b) is the output of epsilon normalization. You don't remove all epsilon translation. 

A transducer such as T2 90 is input-normalized and a method for constructing T 2 90 
from Ti 80 is called an input s-normalization method. The advantage of using a T2 
90 so constructed is similar to the benefits of the s-removal method of the first aspect 
of the first embodiment of the invention. Matching its input with algorithms such as 
composition does not require any unnecessary delay due to the presence of input s's. 
Figures 8(a) and 8(b) illustrate the application of the algorithm in the case of a 
weighted transducer over the tropical semiring. 

Note that the system (2*, u, n, 0, £ *) defines an idempotent semiring K' 
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over the set of strings 2*. A weighted transducer T } 80 over the semiring K can be 
viewed as a weighted automaton A over the cross-product semiring S=K'xK. An 
element of S is a pair ( X , w) where % e 2* is a string and weKi the original weight 
of the transducer. 

The input ^-normalization method applies only to weighted transducers T } 80 
over an arbitrary semiring K that do not admit any cycle with input label s. Cycles 
with both input and output can be removed using for example the ^-removal method 
described according to the first aspect of the first embodiment of the invention. Since 
T } 80 does not admit any cycle with input label c, A does not admit any £-cycle and 
the semiring S is ^-closed for A* Thus the shortest-distance algorithm presented 
above can be used with A £ and, more generally, the ^-removal algorithm presented in 
the previous section applies to A. 

This input ^-normalization system and method relates to the ^-removal method 
in the specific case of semirings of the S type. The result of the ^-removal method is 
an acceptor with no s but with weights in 5. Figure 9(a) shows the result of that 
algorithm when applied to the transducer Tj of Figure 8(a). The transducer 100 of 
Figure 9(a) includes states 102 and transitions 104 (not all labeled) without any s- 
transitions. The representation of transducers does not allow output labels to be 
strings, but transitions can be replaced with output strings by a set of consecutive 
transitions with outputs in S u {s} in a trivial fashion. The result of that 
transformation is of interest and is useful in many contexts. However, the resulting 
transducer does not have the normalization property described above. To ensure that 
input f's are not found on a path before an input non-£ label, there is a need to 
normalize the result of ^-removal in a different way. To each state p t a residual output 
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string y is associated that needs to be output from that state. 

States in the result of ^-normalization correspond to pairs (p, y) where p is a 
state of the original machine and y a residual output string. The residual string 
associated to an initial state is just & The outgoing transitions of a state (p, y 0 ) are 
determined as follows. For each transition from state ptoq with input label %, output 
string yi and weight wi in the result of the ^-removal algorithm, a transition is created 
from state (p, y 0 ) to state (q, d } y 0 yi), with input % 9 output a and weight wj, where a is 
the first letter of y 0 yi, a=e ify 0 yi s. A state (p,y 0 ) is final if p is a final state of the 
original machine and ify 0 = £. When p is final and y 0 * £, then a transition is created 
from (p, y 0 ) to (p, y ( ) with input s and output a with ayj. 

Figure 9 (b) illustrates this construction for the particular case of the 
transducer of Figure 8 (a). As in the case of ^-removal, input c-normalization admits 
a natural on-the-fly implementation since the outgoing transitions of state (p, yo) 112 
of the output automaton can be computed directly using only y 0 and the input s- 
closure of q. The transducer 110 of Figure 9(b) illustrates states 112 and transitions 
114. 

The method according to the first embodiment of the invention may be 
implemented in numerous ways. For example, high level programming languages 
such as Basic, C or other programming language may be used to implement the 
method. The best mode of implementation is a software implementation using a high- 
level programming language. 

Second embodiment of the invention 
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The second embodiment of the invention relates to a system or apparatus for 
^-removal in automata. The system may comprise a variety of different forms. For 
example, a preferable aspect of the second embodiment of the invention is to provide 
a hardware implementation using electronic circuitry such as an EPROM, a 
programmable logic device (PLD) or a large group of logic gates. Some design tools 
such as SPLat (Simple Programmed Logic automation tool) boards have specifically 
been designed for implementation and programming of FSMs. Thus, circuit boards 
may be designed and created to carry out the functionality of the methods disclosed as 
part of the first embodiment of the invention. According to this embodiment of the 
invention, a hardware implementation such as a computer circuit, EPROM, or logic 
board is programmed to perform the steps set forth in the first embodiment of the 
invention. In this regard, the hardware, in whatever form, will receive an input 
weighted automaton A with ^-transitions. Upon the operation of the hardware 
component to the automaton A with ^-transitions, an equivalent weighted automaton B 
with no ^-transitions is created. 

The process performed by the hardware comprises two main steps. The first 
step consists of computing for each state "p" of the input automaton A its ^-closure 
denoted by C[p]: 

C[p] = {(q,w): q e sfpj, d[p,q] = weK- {0}} 

Where sfpj represents a set of states reachable from "p" via a path labeled 
with e. The second step consists of modifying the outgoing transitions of each state 
by removing those labels with s and by adding to be non-£-transitions leading 
each state q with their weights pre- ^multiplied by d[p,q]. 

The second step in the method comprises modifying the outgoing transitions 
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of each state "p" by removing those labeled with s. The method adds to the set of 
transitions leaving the state "p" non-£-transitions leaving each state "4" in the set of 
states reachable from >" via a path labeled with e with their weights pre-^ 
multiplied by the ^-distance from state >" to state "q" in the automaton A. State 
is a final state if some state ' Y' within the set of states reachable from via a path 

labeled with s is final and the final weight p [p] is p[p] = © (d[p 9 q] ® p[q]). 

e[p]r\F 

One aspect of the second embodiment of the invention relates to a computer 
readable medium such as a data disc or other medium having a program stored 
thereon that is operable to perform the method or process described with respect to the 
first embodiment of the invention. In this regard, executable code or source code may 
be stored on the computer readable medium. Those of ordinary skill in the art will 
understand and recognize how to create such a computer readable medium according 
to this embodiment of the invention given the understanding of the method according 
to the first embodiment of the invention. The computer readable medium may be, for 
example, a computer disk, hard disk, read-only-memory, or random access memory. 

Third embodiment of the invention 

The third embodiment of the invention relates to product produced by the 
process described above with respect to the method explained above. Specifically, the 
equivalent weighted automaton B with no ^-transitions is a product that is created by 
the process set forth and described above as the first embodiment of the invention. 
Therefore, the third embodiment of the invention relates to an automaton having no s- 
transitions, the automaton being created according to the ^-removal algorithms 
described herein. 
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What follows is a series of equations related to process of Generic e -Removal 
and Input e -Normalization Algorithms for Weighted Transducers. We begin with a 
theorem and then the proof of the theorem. The following theorem and proof provide 
disclosure related to another aspect of the present invention. 

Theorem 1 Let A = (Z, Q, I F, E } \ p) be a weighted automaton over the semiring 
K right k-closed for A. Then the weighted automaton B result of the s-removal 
algorithm just described is equivalent to A. 

Proof. We show that the function defined by the weighted automaton A is not 
modified by the application of one step of the loop of the pseudocode above. Let A = 
(Z, Q, I F, E y \ p) be the automaton just before the removal of the e-transitions 
leaving state peQ. 

Let x e E*, and let Q(p) denote the set of successful paths labeled with % 
passing through p and either ending at p or following an ^-transition of p. By 
commutativity of ©, we have: 

[A](z) = © KpM) ® ® p(n[x]) © © Up[x]) ® ® pQlM) 

Denoted by S } and S 2 are the first and second term of that sum. The ^-removal at state 

p does not affect the paths not in Q(p) f thus we can limit our attention to the second 

term S2. A path in Q(p) can be factored in: 71 = m, 7i 2 , tc 3 where 7i e , is a portion of 

the path from p to nn E = q labeled with e. The distributivity of ® over © gives us: 

S 2 =( © X{p\x x ]) ® co\_k x ])) ® S 22 
n[7t\[=p 

with: 

S 22 =( © <*>frj)® © ^2]®P(4^2]) 
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= d[p,q]® © 0)[7i2\® p{n[n2\) 
= © (d[p,q]®<D[x 2 ]®p(n[7C 2 ]) 

For paths n such that 7C2 = e: 

S 22 = © (d[p,q\® p{q)) 

which is exactly the final weight associated to p by ^-removal at p. Otherwise, by 
definition of n € , n 2 does not start with an ^-transition. The second term of the sum 
defining S22 can thus be rewritten as: 

eeE[qli[e]*e,7i2=ex2 
The ^-removal step at state p follows exactly that decomposition. It adds non s- 
transitions e leaving q with weights (dfp, q] ® w/e/; to the transitions leaving/?. This 
ends the proof of the theorem. 

Although the above description may contain specific details, they should not 
be construed as limiting the claims in any way. Other configurations of the described 
embodiments of the invention are part of the scope of this invention. For example, 
finite state machines may be used to design computer programs, logic circuits, or 
electronic control systems. The ^-removal algorithm and other algorithms disclosed 
herein may clearly have application outside of speech processing. For example, the 
same algorithm (epsilon-removal) applies in contexts similar to speech such as text 
processing, information extraction, information retrieval, computational biology, etc. 
where weighted automata are used and where one wishes to make their use more 
efficient. Furthermore, the system and method disclosed here can be 
straightforwardly modified to remove transitions with a label a different from s. This 

31 



Attorney Docket No. 2001-0226 U. S. Express Mail Receipt No. EL 758616634 US 

M. Mohri 

can be done for example by replacing shy a new label and a by s 9 applying ^-removal 
and then restoring original e's. Accordingly, the appended claims and their legal 
equivalents should only define the invention, rather than any specific examples given. 
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